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13 PRIORITY 

14 This patent claims priority ofpatent serial number 08/587,084 filed January 16*, 1996and 

15 patent serial number 60/163,057 (provisional) filed November 2 nd , 1999. 

16 BACKGROUND OF INVENTION 

17 FIELD OF INVENTION 

1 8 The technology relates to telephone monitoring, comparing and recording devices. 

19 PRIOR ART 

20 Recording of telephone calls dates back to the 1 920 (an example from Hellwarth is the 

21 Rice patent, 4,71 2,230) and digital recording dates 4,054,756 in 1 976. 

22 It would be beyond the scope of what we do on a day to day basis to perform an 

23 infringement analysis. 
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1 HELLWARTH: (FILED 4/20/89) 

2 The '956 basically comprises an electronic computer system for control of a telephone 

3 instrument having the following elements: 

4 1 . A computer. 

5 2. A connection between the computer to a conventional telephone and switch 

6 network. 

7 3 . A means for generation of detection of telephone signals. 

8 4. A playback mechanism for stored messages. 

9 5 . A detection mechanism for received voice messages. 

3 i o 6. A measuring means for amplitudes and timings and other forms of signals. 

t ll 7. A means for selectively communicating with the calling party. 

2 1 2 8 . A means for selectively communicating with the destination party. 

13 9. A means for selectively communicating with a third party ( The exact method of 
U 1 4 doing this is not well defined) . 

2 15 10. There is a means to control the continuation of telephone calls on two fronts: that 
* 1 5 permit validly charged calls to proceed and to prevent calls and to terminate calls 

17 where there is an invalid credit card number as well as originating calls to 

1 g alternative number other than the numbers supplied by the calling parties. 

19 ii. Asa means for transmitting credit card account numbers to automatic equipment 

20 and to parties at the alternative number in the prior numbered paragraph. 

21 12. There is a means for detecting tone and voice signals to indicate the credit card 

22 status number validity and then there are means for other processes. 



1 Claim 7 includes a means for diagnosing problems and failures in the hardware and 

2 software and a means for the automation computer to alter its own information and programs for 

3 writing and rewriting of programs and a means for updates the software. 

4 Claim 8 involves a means for electronic storage of data, within the automation computer 

5 referred to above; 

6 a means for conversion of signals into discrete, quantified units (this may refer to a digital 

7 conversion); 

8 a linear filter means for the discrete data 'quantified units' from the prior paragraph a 

9 storage and a digital computer; 

1 0 a means for processing the data by stored programs; 

1 1 a means for communicating the data and a means for conversion of the digital data into 

12 (apparently) un-logged signals; 

13 amplification means; 

1 4 a coupling means without putting the signal means for the means for security key storage 

1 5 or other control of the current; 

1 6 a means for comparing the security codes; 

1 7 a means for encoding data using a storage key code which would require that the coding 

18 by the receiving computer would require a key code; 

19 a means counting unsuccessful attempts at establishing communications through the 

20 matching of key codes and 

2 1 a means for outputting data communications to a third party by notifying them of various 

22 security breeches. 



3 



1 Claim 1 6 comprises a telephone instrument at a given site and a computer at that same site 

2 for enabling the use of the telephone instrument requiring the acceptance of charges without the 

3 intervention of a individual. 

4 Hellwarth was filed in 1989 and GlobaPs phones with on-site cpu's which were in 

5 circulation well before the filing date. In fact Dively, cited in Hellwarth shows a telephone with 

6 a CPU filed in 1985. 

7 Claim 28 is almost a method of doing business. This claim broadly covers the steps of 

8 selecting a site and installing a computer to allow calls without a human operator and connecting 

9 the computer to one or more telephone instruments in a remote switch network. 

10 Claim 32 is the last independent claim which includes a computer for modifying the 

1 1 operation of one or more telephone instruments to get acceptance information before the call is 

12 made. 

1 3 Claims 2 1 through 42 were added later and were directed to the onsite connection of an 

1 4 automation computer to one or more telephone instruments. As mentioned, this was common at 

1 5 the time because pay phones were present which had central processing units. 

1 6 BROWN (FILED 8/20/93) 

17 Brown is a phone patent directed towards selectively blocking or recording calls in 

1 8 response to some parameter. There are "parameters" marking calls where the parameter is a 

1 9 specific number, a triggering event, or a call feature or a type of call (such as a call to a specific 

20 number). Most of these events are at least generally present in the prior art as shown below. For 

2 1 example a message in response to a third line on a party call (4,477,698) would be similar "three 

22 way calling". Termination or blocking of calls at this stage is covered in prior art, but not cited 
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1 in the Brown application. Hird I-IV, discussed below (1990 issue dates), shows methods of 

2 reacting to call specific 'parameters'. Hird is also ignored in the Brown prosecution. The calls 

3 are continuously monitored for the parameter in question, calls may be blocked or recorded 

4 selectively and messages may be played back. All of these features are also shown below in the 

5 prior art. 

6 GATEWAY II-McFarlen (filed 3/1 1/96) 

7 Shows a method for determining three way call events. Its relevance is in question, but 

8 the prior art cited may be relevant, since it references Hellwarth and has a common assignee. 

9 HIRD-I-V 

10 The Hird patents cover operator free call placement. All of the claims involve an 

1 1 ' electronic operator' where the phone has stored messages for collecting information from the call 

12 maker and call recipient. Billing information is also retrieved. Storage of call data information 

1 3 (mainly for billing) and automatic termination is discussed. Speech files are digitized and stored 

14 for purposes of playback within the phone. The main concept follows the prior art where the 

15 operator's various tasks are replaced by the cpu and automated responses along with a time 

1 6 keeping function for billing. 

1 7 Another curious factor is that all of these patents except one (a continuing application) 

18 were filed on January 23, 1989. A more complete examination of the file wrappers would be 

1 9 called for if the technology were felt relevant. 

20 There have been 'electronic operators' within phones sold since 1989. These phones 

21 were purchased from inventories of such phones, although there were various upgrades to the 

22 systems as software design and hardware capabilities were refined. Some of this technology was 
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1 felt to be present and in wide-spread use before 1 989. A discussion of the pre-Hellwarth prior 

2 art (from Hellwarth) will shed some additional light. 

3 Patent 4,027,109 discusses call forwarding. Manipulation (termination) of some call 

4 features is discussed. 4,054,756 is a billing acknowledgment system for phones accomplishing 

5 the tasks claimed in Hellwarth and Hird to some extent. Other aspects of the patents examined 

6 are also disclosed, for example claim 3 appears to be a digital storage of data. Encoding of data 

7 is discussed in Claim 10. Significantly, there is no requirement that the system be "off sight" as 

8 claimed in Hellwarth. Another similar patent in scope is Frey, 4,737,577. 

9 Patent 4,371,752 covers storage of telephone data (more in the form of a high tech 

10 answering machine). Forwarding of the calls is covered. Storage and retrieval of call specific 

1 1 data is also covered. 4,477,698 appears to be an early patent for establishing a line signal of a 

1 2 desired type (a telephone pick-up) and providing information primarily for controlling party lines. 

1 3 Patent 4,540,85 5 is another signal detection patent. 

1 4 Rice, 47 1 2,230 is a system for storing and monitoring telephone call discrete information. 

1 5 "Status" data is transmitted to a CPU. Diesel, 4,723,273 is a forwarding patent which allows 

1 6 data from the call to determine if it should be forwarded. 

17 GENERAL DISCUSSION OF THE INVENTION 

1 8 The invention is a telephone system having unique monitoring methods and equipment 

1 9 to allow the user to following conversations and retrieve portions of the conversation and to take 

20 certain actions in connection with conversations. The system has 2 parts. The first part is a novel 

2 1 grouping of elements for greater efficiency, lower costs and convenience. The second part is a 

22 method of manipulating telephone data and interacting with the novel grouping. 
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1 There may be two groups of users within the system, the first being the maker and 

2 recipient of the call and the other being a person or device monitoring the call. PIN markers are 

3 also disclosed. 

4 Several main components are required to form the telephone apparatus about to be 

5 described. Of course, one component is the above-discussed phone system installed at a facility 

6 to provide access control for the telephones located there. The phone system of the facility 

7 operates in conjunction with a central office which is remote from the facility, perhaps even 

8 hundreds or thousands of miles away. The central office handles many such facility phone 

9 systems. Another of the main components is a computer workstation located at the facility. This 

10 is a PC-based apparatus with a variety of tasks, primarily in the nature of an interface. A 

1 1 recording system is another of the main components. It is also located at the facility. Finally, a 

1 2 file server with mass storage is also located at the facility to complete the telephone apparatus. 

13 As can be ascertained from the above, the facility accommodates the workstation, phone 

1 4 system, recording system and the file server with mass storage. These are all networked together. 

1 5 The workstation is utilized as an interface to the telephone system to enter data for controlling 

16 access by the telephone, and individual users thereof, to the PSTN. The workstation is also an 

1 7 interface to the recording system in order to control which phone conversations are recorded. In 

1 8 addition, the workstation is utilized to retrieve data from the file server and its mass storage. 

19 The remotely-located central office provides a variety of services for the facility. The 

20 facility phone system and the central office are in communication through the PSTN by modem 

2 1 or through a direct wire. In either case, a connection between the central office and the facility 

22 phone system can be made as and when the need arises. Such need arises in the following ways. 

7 



1 When access from a phone to the PSTN is sought by a caller, whether or not the call will 

2 be connected is a decision made by the central office. More specifically, when an inmate (in the 

3 prison example being used) wishes to make a telephone call, he will pick up a telephone and enter 

4 the multi-digit personal identification number (PIN number) which was assigned to him. At that 

5 point, the facility phone system will call the central office to communicate this information. The 

6 central office will perform a two-part validation check. The first part determines, based on 

7 phone-related data and PIN number-related data that it has previously received from the 

8 workstation via the facility phone system, whether based on the phone-related data the particular 

9 phone being used is within its activated time period, and whether based on the PIN number- 

1 0 related data the inmate qualifies for the requested call. In particular, such PIN number-related 

1 1 data reveals ( 1 ) whether the owner of the PIN number is permitted to use the phone now and (2) 

12 does the owner of the PIN number have the privilege of accessing the destination number. If so, 

1 3 then the call has passed one part of the validation check. The second part of the validation check 

1 4 determines whether the destination number is a billable number. This is important because the 

1 5 call must be paid for. The inmate typically does not pay for the call (although a pre-payment 

1 6 arrangement is available). The call normally must be made on a collect call basis. However, this 

1 7 creates the possibility of fraud if, for example, the destination number belongs to a pay phone. 

1 8 Thus, at this point the central office dials a service provider (such as SNET, TNS) that maintains 

1 9 a data base which can be used to ascertain whether the destination number is billable. If so, then 

20 both parts of the validation check have been satisfied, and the call is connected. In addition to 

2 1 performing validation checks, the central office also performs maintenance, billing, housekeeping 

22 and various other functions which are not directly pertinent to a description of the invention. 
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1 Just before the call is connected following the successful completion of a validation check, 

2 the recording system determines whether this call should be recorded. Recording control data is 

3 provided to the recording system from the file server, where it was previously stored by the 

4 workstation, and this data is compared with the call-related data (e.g. the origination number, PIN 

5 number, destination number). If the conditions set by the recording control data are met, then the 

6 conversation is recorded. When the call is ended, the recorded conversation data is transferred, 

7 or migrated, to the file server. The conversation data is stored together with the call-related data 

8 and other data useful to facilitate locating and retrieving a particular conversation. When the need 

9 for retrieving a particular conversation arises, certain search parameters are manually entered into 

10 the workstation which then communicates with the file server to identify and locate the 

1 1 conversation in storage. The specified conversation is then retrieved and made available on the 

1 2 workstation for display and/or audio playback. 

13 It is an object of the invention to provide a telephone monitoring device for reading a 

1 4 biological marker for an individual and associating the marker with a pin number and associating 

1 5 the pin number with other call information to be stored with data on the call. 

16 It is an additional object of the invention to provide a phone system with an interface 

1 7 means for storing information on a call from a group of information comprised of the locations 

1 8 from and to which the call is made, the PIN number and name or the maker, time when made and 

19 when finished, data of the call, telephone numbers and the like. 

20 It is an additional obj ect of the invention to convert the telephone call to digital format for 

21 storage and to maintain a database of data, voices or sounds in a digital format, particularly 

22 secondary ring signals, and to compare the digital database of voices or sounds or data 
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1 (particularly phone numbers, names, addresses and area codes) based on user controlled degrees 

2 of similarity and to take different actions from a group of actions including monitoring, marking, 

3 terminating or playing a recording before, after or in conjunction with the ongoing call. 

4 It is a further object of the invention to feed the data to the comparing mechanism at an 

5 accelerated rate, typically 4 to 5 times the speed of the original call, with or without filters for 

6 which isolate voice ranges or data ranges, with or without pitch attenuation to keep the voice at 

7 an apparently normal pitch. 

8 It is a further object of the invention to encode the information in a format providing that 

9 any alteration of the data will result in a mark showing the data has been altered. 

10 It is a further object to allow for data to be selected, stored or played back to be altered 

11 at a graphical user interface, such as a keyboard type entry. 

12 Another object of the invention is to facilitate the use of a phone system located at a 

13 facility to record phone conversations originating from any of its telephones. 

1 4 Another object of the invention is to facilitate the selected retrieval of phone conversations 

1 5 recorded by the phone system. 

1 6 A further obj ect of the invention is to control access by individual telephone users to the 

17 PSTN. 

18 Yet another object of the invention is to control the recording of phone conversations 

1 9 based on the identity of individual telephone users. 

20 Still another object of the present invention is to determine the destination number 

21 accurately and store it for later use. 

22 These and other obj ects of the invention are attained in accordance with one aspect of the 
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1 invention which is directed to a telephone system for communicating telephones located at a 

2 facility with a public switched telephone network (PSTN). A switching means connects the 

3 telephones with the PSTN. Access control data is provided which includes phone-related data 

4 and PIN number-related data. Control means actuates the switching means in accordance with 

5 the access control data. 

6 Another aspect of the invention is directed to a telephone apparatus for communicating 

7 telephones located at a facility with the PSTN. A phone system is located at the facility, 

8 including switching means for connecting the telephones with the PSTN. Access control data 

9 is provided which includes phone-related data and PIN number-related data. Control means 

1 0 actuates the switching means in accordance with the access control data. A computerized central 

1 1 office is located remotely from the facility. A computer workstation is located at the facility 

1 2 along with a computer file server, a computerized recording system and means for communicating 

13 the central office, workstation, file server and recording system. 

14 Yet another aspect of the invention is directed to a telephone apparatus for controlling 

1 5 access by telephones located at a facility to the PSTN and recording selected phone conversations. 

16 Means is provided for storing access control data and recording control data. Call-related data 

17 particular to an attempted call being made from one of the telephones is provided. A phone 

1 8 system is located at the facility, including access control means for providing selected access from 

19 the one telephone to the PSTN by connecting the attempted call based on a comparison of the 

20 access control data with the call-related data. Recording means is coupled to the phone system 

21 for recording conversation data generated when an attempted call has been connected to the 

22 PSTN. Recording control means selects which connected calls are to be recorded based on a 
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1 comparison of the call-related data with the recording control data. Storage means stores the 

2 conversation data of connected calls selected to be recorded. 

3 These and other objects and advantages of the invention will become better understood 

4 hereinafter from a consideration of the specification with reference to the accompanying 

5 drawings forming part thereof, and in which like numerals correspond to parts throughout the 

6 several views of the invention. 

7 BRIEF DESCRIPTION OF DRAWINGS 



8 For a further understanding of the nature and objects of the present invention, reference 

9 should be made to the following detailed description taken in conjunction with the accompanying 

10 drawings in which like parts are given like reference numerals and wherein: 

1 1 Figure 1 a- lb is a flow chart showing the devices as they communicate. 

12 Figure 2 is a flow chart for operating the work station of Figure 1 . 

13 Figure 3 is a flow chart for operating a central office with which the phone system of 

14 Figure 1 communicates and interacts. 

1 5 Figure 4 is a flow chart for operating the phone system of Figure 1 . 

16 Figure 5 is a flow chart for operating the master recording unit of the recording system 

1 7 shown in Figure 1 . 

1 8 Figure 6 is a flow chart for operating the file server of Figure 1 . 

19 Figure 7 is an alternate schematic block diagram of a phone system arranged in 

20 accordance with the invention. 

21 Figure 8 is an alternate schematic block diagram of that shown in Figure 7. 

22 Figure 9 is a detailed schematic block diagram of that shown in Figure 8. 
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1 Figure 10 is an alternate schematic block diagram of a phone system arranged in 

2 accordance with the invention. 

3 Figure 1 1 is a flow chart for the call monitoring function. 

4 Figure 12 is a detail flow chart for the responding function for the flow chart shown in 

5 Figure 1 1 . 

6 Figure 1 3 is a flow chart for the monitoring function of the flow chart shown in Figure 1 1 . 

7 Figure 1 4 is a flow chart for the central control function of the flow chart shown in Figure 

8 11. 

9 DETAILED DESCRIPTION OF THE PREFERRED EXEMPLARY EMBODIMENTS 

10 An electronic computing system is described having parts which interact as shown in a 



1 1 block diagram format in Figures la- lb for use in the monitoring of telephone communications 

1 2 over which users can communicate by means of spoken or GUI commands through a phone bank 

13 1, which may be one or a series of other phones la, lb, etc. as shown in Figures 8 and 9 which 

14 show the specific elements and which are described in more detail below. 

1 5 The telephones of the telephone bank 1 are prior art devices for converting voice signals 

1 6 to electromagnetic signals having wave characteristics. These provide analog voice and DSTM 

17 tone data. The phones and imaging equipment 4 may also send digital data. A phone interface 

18 controller 3 is disclosed which stores the data from the telephone. This controller 3 is a cpu 

1 9 having a hard drive and software for accomplishing this purpose. A more detailed discussion of 

20 the structure of these units follows. 

21 The data from the phone 1 is then associated by way of a data generator 2 with call 

22 preselected data from a group of data comprising start time, finish time, location numbers, pin 
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1 numbers, name of user, phone number called, location of origin, or other call variables. A data 

2 generator 2, such as a clock 2, may be used in conjunction with the phone 1 or controller 3 to 

3 provide the preselected data. In the preferred embodiment, the data generator 2 is within the 

4 CPU. 

5 An analog to digital converter 5 is present for converting the electromagnetic signals to 

6 a digital format as a digital data pack containing the digital call and the call preselected data in 

7 the form of collections of datum within a data storage unit 6 or means for storing the digital data 

8 pack. This storage unit 6 is a hard drive operating with software within the central processing 

9 unit 3. A copy of this data in its original analog format may be allowed to go to the telephone 

1 0 company directly or through the controller when the call is completed as described in more detail 

1 1 with reference to Figures 8 and 9. 

12 The data may be separated so that originating digital data, ring and voice data may be 

13 analyzed separately by a data separator means v; C , The numeric data; phone numbers, PIN 

14 numbers and other data generated initially in a digital format; may also maintained separately 

15 from the beginning but is cross referenced with the voice data of the call by the controller 

16 combining means 6. The separator means is also driven by software separating out the 

1 7 desired portions of the call for the purposes described in more detail below. 

1 8 In the preferred embodiment there are two separate comparing means, the ASR/VPN or 

1 9 voice comparing means 1 6 and the DTMF comparing means 8 which are provided for analyzing 

20 the voice and numeric data and the ring type DTMF data respectively. 

21 As shown in Figure lb a DTMF comparing means 8 takes the call data stored in the 

22 controller 3 and compares the data to a ring tone DTMF data base 1 0 containing pre-selected ring 

14 



1 digital data corresponding to signals in a desired range of timing and frequency from the group 

2 of ring types comprising primary rings, secondary rings, dial tones, or other numbers or data 

3 comparison units. How these are identified and what option is taken is handled through a GUI 

4 interface, which may be from a central office 203 , a local keyboard 3 3 1 or a computer on a Local 

5 Area Network 327. 

6 A grouping function is provided by a separating means 7 within the controller 3 for 

7 grouping datum into datum groups (DG) comparable to the ring digital data in the DTMF 

8 database 10, 

9 The DTMF comparing means 8 compares the datum groups to the ring digital data (RDD) 



1 0 from the call data from the interface means 6 in the call database. Comparing means 8 may also 

11 do a comparison against a number database 18 where digital data corresponding to tones for 

12 numbers are compared to digitally converted analog tones within the call data to determine if 

1 3 specific numbers are present. 



1 4 In order to accelerate the comparisons discussed herein an accelerator means (not shown) 

1 5 may provided to feed the data to the comparing mechanism at an accelerated rate, typically 4 to 

16 5 times the speed of the original call, with or without filters which isolate voice ranges or data 

1 7 ranges, with pitch attenuation to keep the voice at an apparently normal pitch. 

1 8 Alternatively the device may accelerate the data in the ring database 1 0 or word data base 

19 14 or number database 18, discussed below, to obtain adequate comparisons, with or without 

20 pitch attenuation. Acceleration of call data is desirable in order to allow near have real-time 

2 1 analysis of the call 

22 A GUI interface as discussed above is utilized in order to generate data from which the 
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1 comparisons are made. 

2 The comparing means for voice 16 and DTMF signals 8 utilize a comparison method 

3 which includes determining on the basis of a pre-selected percentage of certainty based on the 

4 amount of comparable datum based on timing and frequency between the RDD and the DG as 

5 an identified group. 

6 The device may also include an options data base 1 1 , also entered by GUI, containing a 

7 pre-selected group of options for a particular ring type from the group of options comprising 

8 terminating the call, marking the call with a marking means for associating a marker identifying 

9 the ring type with an identified group, playing a recorded message in conjunction with the call, 

1 0 forwarding the call, monitoring the call, storing the call in a data base with the marker, or related 

1 1 actions in communications with an output means 9 for effectuating the response from the group 

1 2 of options outlined in this paragraph. 

13 A voice comparing means 16 is used where key words or phrases or tone numbers are 

14 analyzed, (as opposed to ring types or other signals, dial tones, background sounds, etc.). The 

1 5 system may include, as a part of the phone interface means 3 a data generator 2 for associating 

1 6 telephone communications with call preselected data from a group of data comprising start time, 

17 finish time or length. Also, data reader 4 may obtain location numbers, pin numbers, name of 

1 8 user, phone number called, location of origin, etc. 

19 An analog to digital converter 5 is present for converting the electromagnetic signals to 

20 a digital format as a digital data pack containing the digital call and the call preselected data in 

21 the form of collections of datum. Process steps take the 48 more or less phomes into which 

22 language may be separated and utilize alphanumerics to take each phome and turn it into 2 
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1 alphanumeric bytes as a part of or along with the analog to digital means. 

2 In this case, a separate voice data base (which could be combined with the ring data base) 

3 1 4 contains pre-selected voice digital data corresponding to specific words, numbers, area codes, 

4 etc. converted to digital data in a desired range of timing and frequency from the various 

5 languages are stored. There may be a GUI (graphical user interface) for entering words or 

6 numbers into the database as described above. 

7 There may be, in this instance, a pronunciation database means 1 2 for converting the GUI 

8 entered words or numbers into phonic digital data corresponding to at least one pronunciation 

9 (or a plurality of pronunciations) for the word. This means is shown as a pronunciation data base 

10 12 for creating digital or analog data corresponding to the sound of the word entered in the GUI 

1 1 interface for comparison to the data in the phone call. 

12 Here, the voice comparing means 1 6 is a second CPU receiving data from the separator 

13 7 in the controller 3 and comparing the data groups to the phonic digital data and determining if 

14 numbers or words in the pronunciation database 12 are present in the call data on the basis of a 

15 pre-selected percentage of certainty, which may be based on the amount of comparable datum 

16 based on timing and frequency between the Voice digital data and the datum group as an 

17 identified group. The comparison may be accelerated as described above so that a real time 

1 8 analysis is possible. 

19 An options database 17 holds options for various words, numbers or DSTM signals 

20 containing a pre-selected group of options for a particular word type or data entry from the group 

2 1 of options. The data may be modified by marking the call or the word within the call data. The 

22 mark may be made with a digital or analog mark corresponding to the data type (preferably digital 
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1 data) to associate a particular mark identifying the ring type or word with an identified response. 

2 This marking is accomplished by a marking means 23 which is a combination of software and 

3 the hard drive storage in the Controller 3 and ASR/VPN voice comparing means 16. 

4 The call may be modified by terminating the call, playing a recorded message in 

5 conjunction with the call, forwarding the call, monitoring the call, telling the controller to store 

6 the call in a data base with the mark, etc. An output means 9 is present for effectuating the 

7 response where the call is modified. 



8 This output means 9 is handled by the controller 3 as described in more detail below.. 

9 One set of responses may be to encode and mark the data as described above or to encode 

1 0 the data with an encoding means 20. This may also be handled by the controller 3 . A secondary 

1 1 mass storage means 3 18 is present for storing completed encoded calls. 

1 2 There may also be a GUI interface on the local area network 327 for obtaining digital data 

1 3 packs or portions of digital data packs based on length from a marked phonic digital data which 

14 is operated by a user who typically would not be a call participant. 

1 5 The voice data base 1 4 may be a GUI interface prepared list including words, area code, 



16 geographic location of called number, name list (last, first, etc.) number of the user, dial tones 

1 7 type, telephone number, number of rings or combinations of these in serial grouping or within a 

1 8 certain time span. 

1 9 Utilizing this or the other data the output means is instructed from a data base containing 

20 a pre-selected group of options for a particular ring type from the group of options comprising 

21 terminating the call, marking the call with a marking means 23 for associating a data marker 

22 within the call data identifying the ring type with an identified group, playing a recorded message 
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1 in conjunction with the call, forwarding the call, monitoring the call, or storing the call in a data 

2 base with the marker. 

3 In this case, the output means 9 for effectuating the response may include responses withi 

4 an output options database 1 1 which are sent to the GUI interface from the list comprising 

5 alerting a listener, dialing a listener, storing the call for the listener, playing back a stored call, 

6 playing the call as it is received for the listener, giving at least some of the pre-selected data on 

7 the call to the listener (who is not one of the primary parties, caller and person called), 

8 conferencing the call to other listeners, and encoding the call either in response to the GUI 

9 interface or automatically, 

1 0 The encoding means 20, which may include a secondary storage 3 1 8 for encoded data is 

1 1 further described as an electronic computing system for use in the monitoring and tracking of 

12 telephone communications over which users can communicate by means of spoken or GUI 

1 3 commands comprising encoding the call data so that changes to the data make changes from the 

14 group comprising: changing a numeric sum based on the data or marking the data to show the 

15 change. 

16 The step of encoding comprises the steps of (1) taking the digital data pack (including 

1 7 start and finish numbers, location, pin number, digitally converted analog conversation/rings, etc.) 

18 running an algorithm to select the numbers according to a preselected formula, determining a 

1 9 mathematical equation based on the manipulation of selected numbers from the group comprising 

20 (sum, subtraction, multiplication, division, integration, encryption, etc.) according to the 

21 selection. 

22 As a part of, or in conjunction with, the telephone means for converting voice signals to 
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1 electromagnetic signals having wave characteristics there may be a Reading means 4 for reading 

2 a biological marker from the group comprising thump print, finger print, retinal pattern, toe print, 

3 signature, etc. In the preferred embodiment, this reading means 4 reads finger print data. 

4 There is also a database 5 viewable directly or indirectly by the comparing means within 

5 the controller 3 or within reading means 4 along with data from the biological marker reading 

6 means 4 which database 5 contains stored copies biological person specific markers and 

7 associated PIN numbers. There is, inherent in the comparison means, which may be incorporated 

8 in the reading means 4, a method for comparing the biological market to the database of stored 

9 copies. 

10 The controller 3 may contain a pre-selected group of options, in the options database 1 1 , 

11 for a particular person identified by biological marker, PIN or credit card from the group of 

1 2 options comprising initiating the call, terminating the call, marking the call with a mark means 

13 for associating a marker identifying the ring type with an identified group, playing a recorded 

1 4 message in conjunction with the call, forwarding the call, monitoring the call, storing the call in 

15 a data base with the marker. 

1 6 This would work along with the data bases as described above containing a pre-selected 

1 7 group of options for a particular PIN number (or biological marker) from the group of options 

1 8 comprising terminating the call, marking the call with a marking means for associating a marker 

1 9 identifying the ring type with an identified group, playing a recorded message in conjunction with 

20 the call, forwarding the call, monitoring the call, storing the call in a data base with the marker, 

21 etc. and the output means 9 for effectuating the response. 

22 Figure 7 shows the previous method depicting a telephone apparatus as including central 
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1 office 203 located remote from the facility. At the facility, a plurality of telephones 1 , here 1 a, 

2 lb, etc. are connected to phone system 207. Switching system 209 schematically depicts a 

3 centralized switching system and associated hardware and software of a telephone company 

4 which provides a plurality of outside telephone lines to phone system 207 for accessing the 

5 PSTN. One telephone line 213 schematically represents the connection of phone system 207 to 

6 central office 203 via the PSTN. 

7 Phone system 207 is connected to recording system 2 1 5 (items 2 1 5a, b, c, etc). Recording 

8 system 21 5 is a multiple channel type and each channel is connected by one of lines 217 to one 

9 of the external lines 211. Recording system 2 1 5 has a master recording unit 2 1 5 A usually with 

1 0 a maximum capacity of around 48 channels. If additional capacity is required, then units 2 1 5B, 

1 1 215C... 215N (N being any integer) can be added, each of which adds a 48 channel capacity. 



1 2 Workstation 2 1 9 is networked to the recording system 2 1 5 as well as to file server 22 1 . 

13 File server 221 is a PC with its own storage device such as a hard disk of specified capacity. 

14 However, mass storage 218 for file serve 221 is available in the form of a readable/writeable 

15 optical juke box. 

16 One implementation available for phone system 207 is Guardian 1600 available from 

1 7 Schlumberger Global Tel*Link in Mobile, Alabama. 

1 8 Master unit 2 1 5 A of recording system 209 utilizes a PC. 

19 Each of units 215B...215N of recording system 215 has the same hardware and software 

20 as master unit 1 5 A, except that its software is configured to operate as a slave. 

2 1 Workstation 2 1 9 is a PC with a processor. 

22 Fileserver221 is a PC based No veil 3. 12 server or a Windows NT 3. 51 server, with a 1 
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1 Gig or larger capacity hard disk and a mass storage device, namely optical juke box 223, 

2 Juke box 223 is model number MaxLyb26XT available from MAXOPTIX Corp. of 

3 Fremont, California. Its storage capacity is 26 Gig, but other sizes are available. 

4 The network is Ethernet. 

5 In one embodiment of the invention, phone system 207 is connected to recording system 



6 2 1 5 by line 220 in the form of an RS-422 connection. This connection is used for the purpose 

7 of transferring call-related data from the phone system 207 so that it can be compared with 

8 recording control data obtained from file server 221 to determine whether or not a phone 

9 conversation will be recorded. Further details in this regard are provided below. For another 

10 embodiment of the invention, phone system 207 and recording system 215 are not connected by 

1 1 line 220. Instead, call-related data is obtained by recording system 215 from outside lines 211 

1 2 via lines 217. Further detail on this embodiment are provided below. 

1 3 Figure 2 is a flowchart for operating workstation 2 1 9 shown in Figure 7. The operator of 

14 workstation 219 enters access control data which is to be utilized to conduct a validation check 

15 when an inmate picks up a telephone to place a call. The access control data is of two types, 

1 6 namely phone-related and PIN number-related. This workstation corresponds to one of the GUI 

17 interfaces 331, 327 described above in reference to Figure IB in the alternate embodiment 

1 8 described in Figure 1 B. 

1 9 The phone-related data is used to determine whether the telephone is active so that a call 

20 connection can be made, independent of the particular inmate that is placing the call. Thus, it 

2 1 may be desirable to have a particular phone, or a group of phones such as those in a particular cell 

22 block, controlled so that calls can only be placed therefrom during certain hours of the day and 
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1 only on certain days (e.g. days of the week, weekends, holidays). Moreover, a maximum duration 

2 for each phone call placed from that phone can be set so that a phone is not monopolized by one 

3 call. 

4 In addition to entering the access control data, the workstation operator must enter the 

5 recording control data which determines whether or not particular phone conversations will be 

6 recorded. The recording control data can also be of two types, namely telephone-related and PIN 

7 number-related. With the telephone-related recording control data, it is possible to record calls 

8 made from particular ones of telephones 1 based on such parameters as the origination number, 

9 destination number, time of day, day of the week, etc. Of course, this is independent of the 

10 identity of the particular inmate placing the call. However, it may also be desirable to record 

1 1 conversations depending on which particular inmate is placing the call. For this purpose, PIN 

12 number-related data is entered in association with the inmate PIN number. 

1 3 The phone-related access control data and recording control data are entered per step 30 

14 when the phone system of a facility is installed and as the need for changes occur. 

15 This phone-related access control data is transmitted to central office 203 per step 32. 

16 This can be done either on a real time basis as each change is made, or it can be done as a batch 

1 7 transmission for a plurality of changes and done at predesignated times, such as during off hours. 

18 The access control data is store in the central office 203 for carrying out the phone-related 

19 validation. 

20 In step 33, the phone-related recording control data is sent to file server 221 from where 

21 it is retrievable by recording system 215. The retrieved recording control data are entered per step 

22 30 when the phone system of a facility is installed and as the need for changes occur. 
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1 This phone-related access control data is transmitted to central office 203 per step 32. 

2 This can be done either on a real time basis as each change is made, or it can be done as a batch 

3 transmission for a plurality of changes and done at predesignated times, such as during off hours. 

4 The access control data is stored in the central office 203 for carrying out the phone-related 

5 validation. 

6 In step 33, the phone-related recording control data is sent to file server 221 from where 

7 it is retrievable by recording system 215. The retrieved recording control data is used for 

8 determining whether a call conversation should be recorded, as discussed above and explained 

9 in further detail below. 

10 PIN number-related access control data and PIN number-related recording control data 

1 1 are entered upon the admission of an inmate, per step 34. Each inmate is assigned a PIN which 

12 is a unique multi-digit number and/or alphabetic characters. Additional data is entered in 

1 3 association with the PIN number to control access by that inmate to telephone privileges based 

14 on such parameters as time of day, day of the week, weekend/holiday, and so on. In addition, 

1 5 restrictions can be placed on the maximum duration of any phone call made by that inmate as well 

16 as on the total amount of telephone spent by that inmate on calls made per day, per week, and so 

1 7 on. It is also possible to control the particular destination numbers to which the inmate can have 

1 8 access. This can be done by either storing a list of telephone numbers which are the only numbers 

19 to which the inmate can place calls, or allowing the inmate to call any number except for a list 

20 of numbers that are stored to which access will be denied. All of the access control data is 

21 manually entered by the operator into the workstation 219 and stored there. 

22 Step 34 also depicts the entry of the PIN number-related recording control data. The 
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1 recording control data that is PIN number-related provides control based on such parameters as 

2 the destination number, origination number, time of day, day of week, etc. 

3 It is also important to inhibit recording of certain phone conversations for legal reasons 

4 and perhaps other reasons as well. For example, calls made by an inmate to his attorney are 

5 considered privileged and, thus, recording thereof is forbidden by law. Thus, the recording 

6 system must be set up so as to avoid having a call made to that particular destination number 

7 recorded. 



8 Once the PIN number-related access control data is entered, it is sent to central office 203 

9 per step 36. This can be done in real time or by batch processing. 

10 The PIN number-related recording control data is sent to file server 221, per step 37. 

1 1 When it is desired to retrieve information from file server 22 1 , workstation 2 1 9 is utilized 



12 for this purpose. Such information can be, for example, in the form of a report or it can be a 

1 3 recorded phone conversation. Examples of reports that can be provided are those sorted by any 

14 one of the following: origination number, destination number, PIN number, frequency, call 

1 5 duration, and group of phones (e.g. by cell block). The information included in the report is that 

16 used for sorting and any and all other call data fields that are available by virtue of having been 

17 stored. 

1 8 The applicable search parameters are entered into workstation 2 1 9 to form a request when 

19 retrieval of a recorded phone conversation is desired, as per step 38. As will be explained in 

20 greater detail below, each phone conversation is stored along with any or all of the call-related 

2 1 data, and possibly other data, and the search parameters that can be used correspond thereto. This 

22 includes the origination number (i.e. the telephone number from which the call was placed), the 

25 



1 destination number, the PEN number, the time of day and the day of the week, the date, and so on. 

2 The search request, as based on the search parameters that are specified by workstation 219, sent 

3 per step 39 to the file server 22 1 which carries out the search through the conversation data that 

4 is stored in juke box 223 . An advantage of having such a mass storage device is the convenience 

5 of being able to search through such a massive amount of data without having to interrupt the 

6 search by removing one storage medium, such as a hard disk or tape, and replacing it with 

7 another. This provides the requested data instantaneously. 

8 A report of all of the phone conversations that fit the designated search parameters is 

9 prepared by the file server and can be called up for display by workstation 2 1 9. A decision by the 
3 1 0 operator can then be made as to which one of the listed conversations is to be played back. Once 
J 1 1 such a selection is made, such as by clicking on the desired call of interest, the file containing the 
-i 1 2 conversation data is retrieved from juke box 223 , and transferred to work station 2 1 9 which is 

13 provided with audio capabilities. The conversation data is then utilized for audio playback 

f! 14 purposes so that the recorded phone conversation can be listened to. Step 40 generally depicts 

t 15 the retrieval of data by workstation 2 1 9 and the display thereof (in the case of a report) and/or 

1 6 playback thereof (in the case of a phone conversation). 

1 7 Figure 3 is a flowchart for central office 203 . In step 4 1 , the central office receives from 

1 8 workstation 1 9 all of the access related data that was stored by the operator. This includes phone- 

1 9 related data and PIN number-related data originally derived from steps 30 and 34 of Figure 2. 

20 This data is permanently stored in central office 203 and available for use as part of the validation 

21 check. When an inmate attempts to place a call, the number of the telephone being used 

22 (origination number), the inmate's PIN number and the destination number are transmitted to 
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1 central office 203, as per step 42. 

2 Step 43 checks whether or not the particular telephone being used is active and whether 

3 the inmate identified by the PIN number has access to telephone privileges at that particular time 

4 and under the then prevailing conditions (e.g. maximum total calling time per day not exceeded). 

5 Based on the result of step 43, step 44 determines whether the origination number and PIN 

6 number are valid. If not, then step 45 sends an "invalid" code signal to phone system 207. A 

7 particular code is used depending on the reason for the invalid status. As a result of receiving 

8 such a code, a suitable message will be produced by phone system 207 to inform the inmate that 

9 the attempted call is being denied. In addition, the message explains the reason for the denial (i.e. 

1 0 depending on the code, either that the particular telephone is not available at that time or that the 

1 1 telephone privileges for the PIN number are not then available.). 

12 If the validity of the origination number and the pin number checks out per steps 43 and 

1 3 44, then the destination number must be validated as well. The destination number is received 

14 from phone system 207 by central office 203 together with the origination number and PIN 

15 number as part of step 42. The destination number is checked, per step 46, by reliance on a 

1 6 service provider utilized for this purpose (e.g. SNET, TNS). These service providers maintain 

1 7 a data base which can be used for the purpose of verifying that the destination number is billable. 

18 Thus, central station 203 accesses the service provider, such as via modem, to request this 

19 information. If step 48 indicates that, based on step 46, the destination number is not billable, 

20 then, per step 50, a unique code signal is sent by central office 203 to the phone system 207. 

21 Phone system 207 will respond to receipt of such a code by producing a suitable message to 

22 inform the inmate of the problem behind the call being denied. If, however, step 48 indicates that 
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1 the destination number is billable, then step 52 conducts other access control checks. One such 

2 check is whether a dollar threshold of calls billed by this PIN number to a particular telephone 

3 number has been exceeded per specified period (e.g. a one month billing period). Another check 

4 is whether a maximum limit on the number of calls by one PIN number has been exceeded in, say, 

5 24 hours. A further check determines whether a threshold of collect call refusals by one particular 

6 telephone number for calls attempted by this PIN number has been exceeded. This is designed 

7 to avoid annoyance calls. If step 52 determines that, based on step 52, the call should be denied, 

8 then step 56 sends a unique "invalid" signal to phone system 207 which will trigger an 

9 appropriate voice message. If, however, step 54 validates the cal, then step 58 sends a "valid" 

1 0 signal to phone system 207 which will enable the call to be connected, thereby granted access for 

1 1 the inmate to the PSTN. 

12 Finally, step 59 of Figure 3 represents the receipt of completed call data from phone 

1 3 system 207 . This data includes the origination number, the PIN number, the destination number, 

1 4 the date, the start time of the call, the completion time, the duration, etc. This completed call data 

15 is stored by central office 203 and is used for billing purposes, for example. It is sent upon 

1 6 completion of the call or as a batch transmission, depending on how quickly the information is 

1 7 needed at the central office. 

18 Turning now to Figure 4, it is a flow chart for phone system 207. Step 60 represents 

1 9 initialization of the system such as, for example, by entering time of day and date. Various other 

20 operations can be included in step 60 which are required to place the facility in a mode in which 

21 telephone access to the PSTN is available via phone system 207 through use of telephones 1, la, 

22 and lb. In step 62 a determination is made whether one of phones 1 has been taken off hook. If 
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1 so, phone system 207 produces audio (e.g., voice) prompts to inform the inmate that his PIN 

2 number and the destination number must be entered, and how to do so (e.g., depress the * key 

3 after each number). Step 64 generally represents all such prompts, although it should be 

4 understood that a separate prompt can be used after each number is entered. The origination 

5 number is determined per step 66. Phone system 207 "knows" the origination number because 

6 it detects which of the lines from its telephone 1 a has gone off-hook, and because a stored table 

7 relates each line to a particular telephone number. 

8 The inputted destination number is determined by the phone system 207 per step 68. This 

9 is done by detecting the DTMF tones produced by the telephone and converting them to the 

10 corresponding numbers. The technique for performing this conversion is well known and, 

1 1 therefore, no details are deemed necessary. Step 70 stores the origination number, PIN number 

1 2 and destination number. Once all of the call-related data has been obtained and stored by phone 

13 system 207, step 72 initiates a communication mode with central office 203 and sends the 

14 origination number, PIN number and destination number thereto. Step 74 determines whether 

1 5 a "valid" signal has been received from central office 203 indicating that the origination number, 

1 6 PIN number data and destination number have been validated by the central office. If not, then 

17 based on which of the "invalid" code signals has been received from central office 203, as 

1 8 determined by step 76, a suitable audio message is played per step 78 to inform the inmate of the 

1 9 problem. If, however, the "valid" signal is received, then step 80 sends a call-start signal to the 

20 recording system 2 1 5 . In addition, the call-related data that has been stored by phone system 207 

2 1 is provided to recording system 2 1 5 as part of an electronic message signal that also includes call 

22 start signal, for reasons to be explained in detail below having to do with whether or not the 
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1 conversation of this phone call will be recorded. Step 82 then awaits receipt of an 

2 acknowledgment signal from recording system 2 1 5 that the call start signal and the call-related 

3 data have been successfully transferred. If no such acknowledgment signal is received within a 

4 given period of time, then the message including the call-related data and call start signal will be 

5 re-transmitted. If no acknowledgment signal is received despite several attempts having been 

6 made (a maximum number of attempts is set to avoid an endless loop), then the call will be 

7 blocked and a suitable audio message will be played, such as that the system is temporarily out 

8 of order. (This step is not shown to keep the drawing from being unduly complex.) 

9 If an acknowledgment signal is received, then step 84 allows the call connection to be 

10 completed so that a phone conversation can take place. Following the initiation of the 

1 1 conversation, step 86 monitors whether the call has ended, or been terminated. This step can 

1 2 include monitoring whether the phone is placed on hook as well as monitoring the access control 

1 3 data which sets a maximum duration for a call placed from this telephone and/or by this inmate. 

14 Thus, if the telephone has not been placed on hook, at a specified time (e.g. 60 seconds) before 

1 5 the call is due to be terminated, phone system 207 provides an audio warning message in the form 

16 of a beep or by voice. (This step is not shown.) 

1 7 Step 88 sends a call end signal to recording system 2 1 5 once the call is ended by the phone 

18 being placed on hook or by termination due to one of the designated time limits (e.g. call 

19 duration, total calls duration) having been exceeded. Step 90 determines whether an 

20 acknowledgment signal from recording system 215 has been received. If not, then another 

2 1 attempt (a maximum number of attempts is set to avoid an endless loop) is made to send the call 

22 end signal. Once the acknowledgment signal is received, then step 92 stores the completed call 
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1 data. In step 94, phone system 207 moves the completed call data to central office 203 at a 

2 suitable time (real time or batch). 

3 A flow chart for recording system 215 is shown in Figure 5. Step 100 receives the 

4 message signal produced by step 80 (Figure 4). Step 101 determines whether a call start signal 

5 has been received from phone system 207 as part of the electronic message signal. If it has, then 

6 step 1 02 sends an acknowledgment signal to phone system 207. Step 1 03 retrieves the previously 

7 stored recording control data from file server 22 1 . Of course, the retrieved data is pertinent to the 

8 origination number and PIN number. Step 104 then conducts a comparison between the recording 

9 control data that it receives from file server 221 and the call-related data that it receives from 

10 phone system 207. Based on this comparison, step 106 determines whether the conversation 

1 1 should be recorded. If not, then the operation comes to its end. If, however, it is indicated by step 

12 106 that the conversation of this phone call should be recorded, then step 108 creates a file 

1 3 identified by a unique file name. Step 1 1 0 records the conversation data which is written to the 

14 just-created file, as per step 112. Step 114 then monitors whether the recording of the 

1 5 conversation data should be stopped. If not, then the writing operation of step 1 1 2 continues. 

16 However, if the recording is to stop, for reasons explained below, then step 1 16 closes the file 

1 7 which is then migrated, per step 1 1 8, to the server with its mass storage. 

18 Returning now to step 101, if a signal is received from phone system 207 but it is not 

1 9 identified as a call start signal, then step 1 20 checks whether it is a call end signal. If it is, then 

20 step 122 sends an acknowledgment signal to phone system 207 and also sends a stop recording 

2 1 signal, per step 1 24, to recording system 2 1 5 to affect step 114. 

22 Figure 6 depicts a flow chart for file server 221. Specifically, step 119 receives and stores 
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1 the recording control data from workstation 21 9. In step 120, file server 221 obtains the files of 

2 telephone conversations recorded by recording system 215. Such files include the file name, the 

3 conversation data stored therein, and the call-related data associated with that particular call . The 

4 files are stored by file server 221 in the mass storage juke box, as per step 122. If step 124 

5 determines that recording control data has been requested by the recording system 215, step 1 26 

6 retrieves and sends it. If step 1 28 determines that a request has been obtained from workstation 

7 2 1 9 for a report or a designated phone conversation as per particular search parameters, file server 

8 22 1 carries out the search and provides the data as per step 130. 

9 In a second embodiment of the invention, no direct connection is provided between phone 

10 system 207 and recording system 215. In other words, line 20 (Figure 1) is not used. Such a 

1 1 situation will arise when a phone system 207 already exists before the remaining components of 

12 telephone apparatus 1 are obtained, and compatibility may be a problem. With such an 

13 arrangement, it is not possible to provide all of the access control data to the recording system 

14 from the phone system. Thus, the destination number and PIN number entered by the caller 

1 5 cannot be fed to the recording system. However, although the PIN number (and of course the 

1 6 origination number) cannot be provided to recording system 2 1 5 , the destination number can be 

17 derived from the DTMF tones via lines 217. Thus, control of whether or not to record can be 

18 based on the destination number and, of course, other parameters readily available to the 

19 recording system, such as date, day of the week, time of day, etc. Based on these parameters, 

20 steps 103, 104, 106, 108, 110, 112, 114, 116, and 118 of Figure 5 can be carried out. Of course, 

2 1 step 1 1 4 will not be based on receipt of a call end signal from phone system 207 but, rather, on 

22 sensing that the phone has been placed on-hook. 
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1 Although a detailed description of preferred embodiments of the invention has been 

2 provided above, various modifications thereto will be readily apparent to anyone with ordinary 

3 skill in the art. For example, incoming calls can also be handled by the telephone apparatus by 

4 using the "caller ID" feature to determine the telephone number from which the incoming call 

5 was placed. That data can be used to control access as well as whether to record the conversation. 

6 Also, the validation check as to one or more of the origination number, PIN number and 

7 destination number can be done at the facility rather than at the central office. In addition, the 

8 capability for prepaid calling can be provided. More specifically, rather than handling the 

9 outgoing calls on only a collect call billing basis, each inmate can prepay a certain amount into 

1 0 an account. Then, validation step 46 (Figure 3) can be replaced with a check on the balance left 

1 1 in the inmate' s prepaid calls account. If insufficient funds remain, the call is denied. Also, if the 

12 balance is exceeded during a call, the call could be terminated. Moreover, another possible 

1 3 modification involves the situation if a destination number is dialed more than a preset threshold 

1 4 of times, that destination number will be automatically recorded thereafter. Another modification 

15 is to add a self-learning capability so that some data can be entered automatically into the system 

16 rather than being inputted manually. For example, rather than manually entering a list of 

1 7 telephone numbers that the inmate is permitted to call, this list can be generated automatically by 

1 8 including in it all the numbers called by that inmate during a given period (e.g. one month). 

19 An alternative embodiment of the invention disclosed above moves several of the 

20 functions from the remote location to a local computer system which allows the same functions 

21 between a local cpu and a centralized cpu but utilizes the division of functions as shown in 

22 Figures 8 and 9. 
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1 Referring to Figure 8, it can be seen that like the embodiment in Figure 7, the device has 

2 a bank of telephones 1, comprised of one or more phones la, lb, etc. These are joined to a local 

3 telephone system 13 which is, in turn connected to a central control station 203. In this 

4 embodiment, the phone system 13 is handled by a central processing unit (CPU) Controller 3 

5 utilizing a series of voice modems 300 or comparable communicating devices joined together by 

6 a BUS 310 and controlled by the controller 3 as described in more detail in the discussion of 

7 Figure 9 below. 

8 The CPU also communicates with several work station GUI's 328 through a local area 

9 network 327 and to the telephone service provides or telephone company 335 through voice 

1 0 modems 300. Current BUS technology allows for several voice modems 300 to be controlled by 

1 1 a single CPU (central processing unit), here Controller 3 . 

12 Referring to Figure 9, the Controller CPU Controller 3 has a communications bus 310 

13 which receives voice modems 300. These are powered bythe controller supply power 301. This 

14 bus 3 10 powers the phone bank 1 and receives analog or digital data from the phones la, lb, etc. 

15 in phone bank 1. In the prior example, the invention utilized a network of recording systems. 

1 6 This is replaced with multiple voice modems 300 connected into the bus 3 1 0. Individual multi- 

17 wire lines run from the individual voice modems 300 to the individual phones la, lb, etc in the 

1 8 phone bank 1 as known in the art for individual phones. The modems and phones used here have 

1 9 connections designed to receive these phone lines as is known in the prior art although this novel 

20 arrangement as taught alternatively in the description of Figure 7 is not known. 

2 1 The power supply 3 0 1 for the Controller CPU provides the power for the CPU Controller 

22 3 and the modems 300 through the bus 310. Another high speed digital data modem 303 
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1 communicates the CDR record of the phone call and receives billing and data messages from the 

2 central control unit 203 . 

3 One or more network cards 321 within the controller 3 communicate with the local area 

4 network 327 which in turn allows the cpu Controller 3 to communicate with the GUI units 328 

5 on the local area network 327. Software and hardware within the Controller CPU include 

6 digitizing means analog to digital converter 5 for taking analog signals from the phone bank 1 and 

7 other data generators and turning them into digital signals for storage within the controller 3 and 

8 comparison purposes described below. 

9 Least call routing determines the lowest cost for an outgoing call. Here, the determination 

10 is made by sending the preliminary CDR record [record of what call is being placed] via high 

1 1 speed digital modem 303 to the central control unit 203. This allows several phone systems 13 

1 2 at different locations to rely on call data maintained at a single location. An alternative would be 

1 3 to have information on least call routing to be periodically received by each of the phone systems 

14 13 from the central control unit 203 in the form of electronic data packages which are used for 

15 updating software. The central control unit 203 provides call information correcting the dial 

1 6 string (the numbers which place the call through the telephone company to minimize the cost) and 

17 possibly providing information on what output option to use if any of the database of output 

1 8 options is located at the central control unit 203 where they may be divided between the controller 

1 9 and the data in a central CPU unit 203 . 

20 Yet another interface from the Controller CPU is the Controller GUI, here keyboard 331 

2 1 and display 332 interface which allow the user to directly access the Controller CPU and monitor 

22 information from the Controller CPU. 
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1 Either the Central Control Unit 203 or the Controller CPU Controller 3 has software to 

2 select responses and a database of recorded messages 305 to the various conditions to which the 

3 system is programed to respond as set forth above. The same voice modems 300 can be used to 

4 take these messages (which may first be converted from digital to analog format using software 

5 and hardware analigous to the analog to digital means analog to digital converter 5) and send 

6 these to the telephone company 3 3 5 or to the phone bank 1 depending on where the message must 

7 be sent prior to completing the call. 

8 The Controller CPU Controller 3 has a limited capacity hard drive storage means 307 (a 

9 part of the interface 3 for receiving and storing data described with reference to Figure 1 a) which 

10 stores ongoing call data while it is processed and while the call is on-going. Also incorporated 

1 1 within the Controller CPU Controller 3 is one or more data generators 2 which generate time and 

12 date (using a clock and calendar within the computer and timing software 313) data which is 

13 utilized to mark the call and to determine it's length for billing purposes as described in more 

14 detail in the process descriptions of Figures 10-14 below. Also, there are databases, as described 

15 above, with information giving the location of the call and identifying the user with a PIN or 

1 6 other identifier utilizing identification association software as described above and in the process 

1 7 descriptions which follow. 

1 8 Data is typically split into a filename and content database 3 1 6 which contains all of the 

1 9 digital information relating to what is said in the call and filename and call data record database 

20 (CDR) 317 which is sent to the central unit 203 for billing purposes. The data is also copied to 

21 the RAID mass storage unit 3 1 8 as described below. The RAID contains the file name, to allow 

22 cross referencing to the CDR 3 1 7 and content. It may also maintain separately, to provide quicker 
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1 and more confidential access, the filename associated with the CDR data comprised of the date, 

2 time, length of call, PIN number or other identifier, phone location where the call was placed, 

3 how the call was terminated, how the call was billed (debit or credit or collect or cash are typical 

4 examples) how the call was accepted, who was called and the location of marked items and the 

5 nature of the marked items. 

6 The data within the Controller CPU Controller 3 is mirrored utilizing a mirroring means 

7 302 ofsoftware and hardware within the controller 3. A network card 333 in the controller CPU 

8 Controller 3 communicates with a mass storage or RAID array 318. This mass storage 318 is 

9 large enough to take all of the data from several calls and store them indefinitely. This RAID 3 1 8 

1 0 may communicate with an optical storage unit 23 as described above, although in the preferred 

1 1 embodiment, this is unnecessary. Mirroring of data within the RAID 3 1 8 may be accomplished 

12 in the same manner as that handled in the Controller CPU Controller 3. 

1 3 The voice data in the digital format is sent, here by a network card 333, to the ASR (auto 

14 speech recognition) means which is the voice comparing means 16 which recognizes keywords 

1 5 by comparing the digital information of the telephone call from the phones in the phone bank 1 

16 to a database of key words, voice database 1 4, and marks where the keywords are located within 

1 7 the digital voice data. The ASR comparing means 1 6 may also tell the controller 3 to take certain 

1 8 actions depending on instructions associated with one or more keywords as determined by a user 

19 at a GUI interface which may be on the LAN 327. In the preferred embodiment, these actions 

20 are taken by the Controller 3 based on what is identified by the ASR comparing means 16. 

21 Here the ASR is a combination of speech recognition software and a CPU. This ASR 

22 function may occur in real time or on recorded data. The data may come directly from the 
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1 Controller 3 if the data is analyzed in real time or from the MASS storage means 318 if it is 

2 analyzed historically. The nature of the analysis is determined by the commands entered by the 

3 user through one of the GUI interfaces described above. 

4 The ASR comparing means 16 may also act to determine the nature of DTMF signals. 

5 Based on the identification which occurs, the Controller 3 may take certain steps as outlined 

6 above. Any of the ASR functions may be handled by hardware and software within the Controller 

7 although economies of time are recognized by having the voice recognition functions handled 

8 separately from the communications functions given the amount of data which must be processed 

9 in real time voice analysis. 

10 It is the function of the central control 203 to communicate through the voice modems 300 

1 1 with the telephone company 335. This may be done through the Controller 3 as a call placing 

12 computer which connects and communicates with the telephone network by way of the voice 

13 modems 300 using strings supplied by the central control 203. 



14 Once the data has been processed, it is marked, encoded and permanently stored. 

15 Figures 11 through 14 show the process steps in practicing this invention including 

16 structural elements where necessary for a complete understanding of the invention. 

17 Referring to Figure 1 1, it can be seen that an initial step to practicing the invention is 

1 8 generating options databases 1 5 1 which the process will utilize in order to determine what actions 

19 to take. These databases include PIN and Name Data, Bio-marker Data, DTMF Data, Word and 

20 Phone number and generic number data, Response option data, and Second user response data. 

21 While these data types are subject to sub-grouping or regrouping, for purposes of the process 



38 



1 discussion which follows, they are identified separately in this fashion. 

2 Once the system has sufficient options to function, the next step is inputting call data 1 52 

3 from the end user originator of the system, typically a prison inmate. Simultaneously, the step 

4 of generating Date and Time data 153 occurs. This is typically accomplished by a calendar-clock 

5 combination internal to the Controller CPU. The step of Inputting Bio-marker data 1 54 may be 

6 a pre-requisite to the call data 1 52 or may occur during the process at this stage. 

7 While the exact order of these processes is subject to some variation, the step of 

8 combining the data 155 and then converting the analog data to digital data 196. If some of the 

9 data originates as digital data, it would be combined after the conversion. The next step is 

1 0 separating the data 1 56 for analysis follows the accepting of the data. The types of analysis occur 

1 1 at two different locations. One is the controller unit and one is the central unit. The central unit 

12 initially only handles billing and call placing functions. 
13 

14 The next step is comparing 157 the data to the data generated in step 151. The system 

1 5 then engages in responding 158 based on the comparison of actions. 

1 6 Figure 1 2 shows the steps associated with responding which include terminating the call 

17 159 based on information held in the controller data or sending the call information to the central 

1 8 processing location 1 60 for placing the call. This function may be moved to the local computer, 

19 but for purposes of the preferred embodiment, this is handled at a remote facility. This 

39 



1 information is retained for billing information and is supplemented at the termination of the call 

2 with the termination information. 

3 The next step is that the central location takes steps which are shown in Figure 14. There 

4 is generating data 161 which mainly consists of least call routing and call placing data. The 

5 computer at the central location takes the steps of receiving call data from the controller, storing 

6 the data from the controller, comparing the data to the call placing data and generating call data 

7 166 which is then sent back to the controller by way of the step of sending call data back to the 

8 controller 167. 

9 Referring back to Figure 12, the next step at the controller is receiving information from 

1 0 the central computer 1 62. Based on the information received the next step is responding 1 68 by 

1 1 terminating the call 1 69 or by connecting the call to the telephone company. After the connection 

12 is made, the next step is soliciting a response from the second end user 171. This utilizes a 

13 database of solicitation options. A response is received from the user and the next step is 

14 comparing the response of the second user 173 to a database of second user rsponses 174 which 

1 5 results in terminating the call 1 75 or monitoring the call 1 76 according to the list of options for 

1 6 connecting and monitoring calls. 

17 At any stage where the call is terminated, the termination step may include the step of 

1 8 informing the first end user of the system of the reason for the termination or such other message 

19 as is appropriate under the circumstances. 

40 



1 

2 The monitoring options always include connecting the call 195 so that the two or more 

3 end users may engage in the conversation desired. The monitoring options database allows for 

4 a number of responses. Initially these include, in the preferred embodiment storing the data 1 78 

5 which may include the step encoding the data 1 80 and may include mirroring the data within the 

6 controller 1 83 or storing the data in a mass storage unit 1 84. It may also include the subsequent 

7 steps of accessing or retrieving the data 1 85 or decoding the data 1 86 which may include the step 

8 of reconverting the data from digital to analog format or reducing the digital data to a typed 

9 format. 

1 0 While the data is stored to the extent necessary, the purpose of comparing 1 8 1 the digital 

1 1 voice data of the phone call from the interface means 6 to the voice database 14 in ASR voice 

12 recognition and comparison means 16 shown in Figure 9, located in close proximity to the 

13 controller 3 is in order to allow real time (or near real time) comparison. 

14 If a comparison is made, the next step is marking 1 89 the data and combining 1 88 the new 

15 data with the old data stored in the interface means as data for storage shown as 179. 

1 6 Simultaneously, the call may be terminated as shown in terminating step 1 87 as a response. Other 

17 responses are notifying 190 a third party of the occurrence, and sending the information to the 

18 controller 3 which upon receiving 191 the data in step 188 compares the mark made in the 

19 marking 189 of the data to a database of options 11 and responding 193 accordingly by 

20 terminating the call 187 or by various forms of monitoring 194 as described above. 

2 1 Because many varying and different embodiments may be made within the scope of the 
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1 inventive concept herein taught and because many modifications may be made in the 

2 embodiment(s) herein detailed in accordance with the descriptive requirements of the law, it is 

3 to be understood that the details herein are to be interpreted as illustrative and not in a limiting 

4 sense. 

5 CLAIMS: I Claim: 

6 1. An electronic computing system for use in the monitoring of telephone 

7 communications over which users can communicate by means of spoken or GUI commands 

8 comprising: 

9 1) a telephone means for converting voice signals to electromagnetic signals having wave 

10 characteristics; 

11 2) an analog to digital converter means for converting the electromagnetic signals to a digital 

12 format as a digital data pack containing the digital call and the call preselected data in the form 

13 of collections of datum; 

14 3) a phone interface means for associating telephone communications with call preselected data 

1 5 from a group of data comprising start time, finish time, location numbers, pin numbers, name of 

1 6 user, phone number called, location of origin, date, type (credit/debit/collect, local, long distance, 

17 cost, minute, rate); (this step may be after 3 or during 3) 

18 4) a data storage means for storing the digital data pack; 

19 5) a data base containing pre-selected ring digital data corresponding to signals in a desired range 

20 of timing and frequency from the group of ring types comprising primary rings, secondary rings, 

2 1 dial tones, sound, DTMF; 
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1 data; 

2 7) a comparing function for (b) comparing the groups to the ring digital data; (c) determining on 

3 the basis of a pre-selected percentage of certainty based on the amount of comparable datum 

4 based on timing and frequency between the RDD and the DG as an identified group; (d) 

5 8) a data base containing a pre-selected group of options for a particular ring or phone type from 

6 the group of options comprising terminating the call, marking the call with a marking means for 

7 associating a marker identifying the ring type with an identified group, playing a recorded 

8 message in conjunction with the call, forwarding the call, monitoring the call, and storing the call 

9 in a data base with the marker. 

10 9) an output means for effectuating the response. 

11 2. An electronic computing system for use in the monitoring of telephone 

12 communications over which users can communicate by means of spoken or GUI commands 

13 comprising: 

14 1) a telephone means for converting voice signals to electromagnetic signals having wave 

15 characteristics; 

16 2) a phone interface means for associating telephone communications with call preselected data 

1 7 from a group of data comprising start time, finish time, location numbers, pin numbers, name of 

1 8 user, phone number called, length of call, and location of origin. 

19 3) an analog to digital converter means for converting the electromagnetic signals to a digital 

20 format as a digital data pack containing the digital call and the call preselected data in the form 

21 of collections of datum; 

22 4) a data storage means for storing the digital data pack; 
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1 5) a data base means for containing pre-seiected voice digital data corresponding to specific 

2 words converted to digital data in a desired range of timing and frequency from the group various 

3 languages; 

4 6) a GUI interface for entering code words into a database; 

5 7) a means for converting the code words into phonic digital data corresponding to at least one 

6 pronunciation (or a plurality of pronunciations) for the word; 

7 8) a grouping function (a) for grouping datum into datum groups comparable to the voice digital 

8 data; 

9 9) a comparing function for (b) comparing the groups to the phonic digital data; (c) determining 

10 on the basis of a pre-selected percentage of certainty based on the amount of comparable datum 

1 1 based on timing and frequency between the VDD and the DG as an identified group; 

12 10) a data base containing a pre-selected group of options for a particular word type from the 

13 group of options comprising terminating the call, marking the call with a marking means for 

14 associating a marker identifying the ring type with an identified group, playing a recorded 

1 5 message in conjunction with the call, forwarding the call, monitoring the call, and storing the call 

16 in a data base with the marker to make a marked phonic digital data; 

17 1 1 ) an output means for effectuating the response; 

18 3 . The invention of claim 2 further comprising: 1 2) A GUI interface for obtaining digital 

1 9 data packs or portions of digital data packs (based on length from a marked phonic digital data. 
20 

21 4. The invention of claim 2 further comprising an encoding means for selectively 

22 encoding the data so that it would be unalterable without modification of the data. 
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1 5. An electronic computing system for use in the monitoring of telephone 

2 communications over which users can communicate by means of spoken or GUI commands 

3 comprising: 

4 1) a telephone means for converting voice signals to electromagnetic signals having wave 

5 characteristics; 

6 2) a comparing means for associating telephone communications with call preselected data from 

7 a group of data comprising start time, finish time, location numbers, pin numbers, name of user, 

8 phone number called, and location of origin; 

9 3) a data base containing a pre-selected group of options for a particular word type from the group 

10 of options comprising terminating the call, marking the call with a marking means for associating 

11 a marker identifying the ring type with an identified group, playing a recorded message in 

12 conjunction with the call, forwarding the call, monitoring the call, and storing the call in a data 

1 3 base with the marker to make a marked phonic digital data; 

14 4) an output means for effectuating the response. 

15 6. The invention of claim 5 further comprising a data base containing pre-selected 

16 telephone numbers selected by the group comprised of GUI interface prepared list, area code, 

1 7 geographic location of called number, name list (last, first, etc) of number user, dial tones type, 

1 8 telephone number, and number of rings. 

19 7. The invention of claim 5 further comprising a grouping function (a) for grouping 

20 datum into datum groups comparable to the ring digital data; a comparing means for (b) 

21 comparing the groups to the ring digital data; (c) determining on the basis of a pre-selected 

22 percentage of certainty based on the amount of comparable datum based on timing and frequency 
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1 between the RDD and the DG as an identified group; d) a data base containing a pre-seiected 

2 group of options for a particular ring type from the group of options comprising terminating the 

3 call marking the call with a marking means for associating a marker identifying the ring type with 

4 an identified group, playing a recorded message in conjunction with the call, forwarding the call, 

5 monitoring the call, and storing the call in a data base with the marker and e) an output means for 

6 effectuating the response said output means comprising one or more of a group comprising 

7 alerting a listener, dialing a listener, storing the call for the listener, playing back a stored call, 

8 playing the call as it is received for the listener, giving at least some of the pre-seiected data on 

9 the call to the listener, conferencing the call to other listeners, and encoding the call. 

10 8. An electronic computing system for use in the monitoring and tracking of telephone 

1 1 communications over which users can communicate by means of spoken or GUI commands 

12 comprising: 

13 1) a telephone means for converting voice signals to electromagnetic signals having wave 

14 characteristics; 

15 2) a phone interface means for associating telephone communications with call preselected data 

1 6 from a group of data comprising start time, finish time, location numbers, pin numbers, name of 

17 user, phone number called, and location of origin; 

18 3) an analog to digital converter means for converting the electromagnetic signals to a digital 

19 format as a digital data pack containing the digital call and the call preselected data in the form 

20 of collections of datum; 

21 4) a data storage means for storing the digital data pack. 

22 9, The invention of claim 8 farther comprising a data base containing pre-seiected 
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1 telephone numbers selected by the group comprised of GUI interface prepared list, area code, 

2 geographic location of called number, name list (last, first, etc.) of number user, dial tones type, 

3 telephone number, and number of rings; a grouping means (a) for grouping datum into datum 

4 groups comparable to the ring digital data; a comparing means for (b) comparing the groups to 

5 the ring digital data; (c) determining on the basis of a pre-seiected percentage of certainty based 

6 on the amount of comparable datum based on timing and frequency between the ROD and the DG 

7 as an identified group; a data base containing a pre-selected group of options for a particular ring 

8 type from the group of options comprising terminating the call, marking the call with a marking 

9 means for associating a marker identifying the ring type with an identified group, playing a 

1 0 recorded message in conjunction with the call, forwarding the call, monitoring the call, storing 

1 1 the call in a data base with the marker, and encoding the data and storing the data in the encoded 

12 form; and an output means for effectuating the response said output means comprising a means 

1 3 for doing items from the iist comprising alerting a listener, dialing a listener, storing the call for 

14 the listener, playing back a stored call, playing the call as it is received for the listener, (3) giving 

15 at least some of the pre-seiected data on the call to the listener, conferencing the call to other 

16 listeners, encoding the call data so that changes to the data make changes from the group 

1 7 comprising: changing a numeric sum based on the data, and marking the data to show the change. 

18 10. The invention of claim 9 wherein the step of encoding comprises the steps of (1) 

19 taking the digital data pack (including start and finish numbers, location, pin number, digitally 

20 converted analog conversation/rings, etc.) running an algorithm to select the numbers according 

21 to a preselected formula, determining a mathematical equation based on the manipulation of 
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1 integration, and encryption) according to the selection of a key alphanumeric unlocking code. 

2 11, An electronic computing system for use in the monitoring of telephone 

3 communications over which a specific person can communicate by means of spoken or GUI 

4 command s comprising : 

5 1) a telephone means for converting voice signals to electromagnetic signals having wave 

6 characteristics; 
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8 retinal pattern, toe print, and signature; 

9 3) A database of stored copies biological person specific markers and associated PDSf numbers; 
1 10 4) a comparison means for comparing the biological market to the database of stored copies; 

* 11 5) a data base containing a pre-selected group of options for a particular PIN number from the 

1 3 marking means for associating a marker identifying the ring type with an identified group, playing 

i j 14 a recorded message in conjunction with the call, forwarding the call, monitoring the call, storing 

3 1 5 the call m a data base with the marker, and billing the person. 

1 6 1 2. A telephone system for transferring speech to a telephone company comprised of at 

17 least one telephone; at least one modem connected to a computer BUS, a phone line connecting 

1 8 the at least one telephone to the at least one modem; at least one second modem connected to the 

19 computer bus connected to the telephone company for connecting the at least one telephone to 

20 the telephone company over the BUS ; a controller means for controlling communication between 

21 the first modem for transferring data and the second modem means for transferring data. 

22 13. The invention of claim 12 farther comprising a voice database of at least one tone 
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1 signal and a comparing means in communication with the controlling means for comparing the 

2 database of signals to the speech; an output means for effectuating a response to when the speech 

3 corresponds to the at least one tone signal 

4 14. The invention of claim 1 3 wherein the voice database is in digital format and wherein 

5 the controlling means and wherein the speech is digital and farther comprises a converting means 

6 for converting the speech from analog to digital. 

7 15. The invention of claim 14 wherein the controlling means comprises a database of 

8 responses available from the group comprised of initiating the call, terminating the call, marking 

9 the call with a marking means for associating a marker identifying the ring type with an identified 
3 1 0 group, playing a recorded message in conjunction with the call, forwarding the call, monitoring 
* 1 1 the call, storing the call in a data base with the marker, and billing the person. 



y 12 16 The invention of claim 1 2 further cnronri^incf p +V»ii*H mnrlpm cmrl wlijarpin tho fhirrl 

1 3 modem means is in communication with a central unit means responds to speech information by 

yj 1 4 sending the controller means information to send to the telephone company to complete the call 

:! 15 17. The invention of claim 1 2 further comprising a mirroring means for storing a copy 

3 16 of the data while it is received. 

17 18. The invention of claim 1 2 further comprising a fourth modem means for transferring 

1 8 data connecting the controlling means with a large storage unit for maintaining the information. 

19 19. The invention of claim 12 further comprising a network card means for transferring 

20 data and at least one local area network connected to the network card means and at least one GUI 

2 1 connected to the local area network for receiving information from the controller means relative 

22 to the speech. 
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1 ABSTRACT 

2 A telephone operating system is described. The invention is a telephone system have 

3 unique monitoring methods and equipment to allow the user to following conversations and 

4 retrieve portions of the conversation and to take certain actions in connection with conversations, 

5 There may be two groups of users within the system, the first being the maker and 

6 recipient of the call and the other being a person or device monitoring the call. The system 

7 provides a telephone monitoring device for reading a biological marker for an individual and 

8 associating the marker with a pin number and associating the pin number with other call 

9 information to be stored with data on the call along with an interface means for storing 
3 1 0 information on a call from a group of information comprised of the locations from and to which 
* 1 1 the call is made, the PIN number and name or the maker, time when made and when finished, 
^ 12 data of the call, telephone numbers and the like. The system may convert the telephone call to 

1 3 digital format for storage and to maintain a database of data, voices or sounds in a digital format, 

y 14 particularly secondary ring signals, and to compare the digital database of voices or sounds or 

3 15 data (particularly phone numbers, names, addresses and area codes) based on user controlled 

3 16 degrees of similarity and to take different actions from a group of actions including monitoring, 

1 7 marking, terminating or playing a recording before, after or in conjunction with the ongoing call. 

1 8 The invention to feed the data to the comparing mechanism at an accelerated rate, typically 4 to 

19 5 times the speed of the original call s with or without filters for which isolate voice ranges or data 

20 ranges, with or without pitch attenuation to keep the voice at an apparently normal pitch. 
21 
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